perm filename WEIZEN.REV[PUB,JMC] blob sn#291637 filedate 1977-06-27 generic text, type C, neo UTF8
COMMENT ⊗   VALID 00008 PAGES
C REC  PAGE   DESCRIPTION
C00001 00001
C00002 00002	.require "memo.pub[let,jmc]" source
C00013 00003	
C00020 00004	
C00026 00005	.item←0
C00033 00006	
C00058 00007	
C00068 00008	
C00081 ENDMK
C⊗;
.require "memo.pub[let,jmc]" source;
.cb AN UNREASONABLE BOOK
.skip 2
.begin indent  0;
Joseph Weizenbaum, %2Computer Power and Human Reason%1, W. H. Freeman Co.,
San Francisco 1975
.end;

	This moralistic and incoherent book uses computer science and
technology as  an illustration to support the  view promoted by Lewis
Mumford, Theodore Roszak, and Jacques Ellul, that science has  led to
an  immoral view of  man  and  the world.
I am frightened by its arguments that  certain research should not be
done if it is based on or might result in an "obscene" picture of the
world and man.  Worse yet, the book's  notion of "obscenity" is vague
enough to admit arbitrary interpretations by activist bureaucrats.

.cb IT'S HARD TO FIGURE OUT WHAT HE REALLY BELIEVES ...

	Weizenbaum's style  involves making extreme  statements which
are  later qualified by contradictory  statements.  Therefore, almost
any quotation is out  of context, making it difficult  to
summarize his contentions accurately.

	The following passages illustrate the difficulty:	

	%2"In  1935,   Michael  Polanyi"%1,   [British  chemist   and
philosopher of science,  was told by] %2"Nicolai Bukharin, one of the
leading theoreticians  of  the Russian  Communist party,  ...  [that]
'under socialism the  conception of science pursued for  its own sake
would  disappear, for the interests of scientists would spontaneously
turn to the problems of  the current Five Year Plan.'  Polanyi sensed
then  that  'the  scientific  outlook  appeared to  have  produced  a
mechanical conception of man and history in which there was no  place
for  science  itself.'  And  further  that  'this  conception  denied
altogether any intrinsic power to thought and thus denied any grounds
for claiming freedom  of thought.'"%1 -  from page  1.  Well$  that≥f~∃G1KCdA∃]←kO vA/K%uK]E¬kZAM¬m←ef↓MeKK⊃←ZA←_AiQ←UOQhA¬]HAg
SK]G∀AC]H↓Sf~∃]←eeS∃HACE=khAi!eKCiLAi↑AQQKZ\A¬kh↓←\Aa¬OJ@dXjXAo∀AQCm∀~∀~∀∀dE'G%K]iSMifAo!↑AG←9iS]k∀Ai↑AAeCii1JA←\↓CE←kP@OW]=oYKI≥JAM←HASif↓←o\~)gCWJ≤@AS\↓←eIKHAi↑@↓KqaY=ShAi!Ch@AMY←OC8AM←d↓iQKSH@AgK1L[gKImS]N↓K]If4∃QCm∀AIKi¬GQKH↓gGSK9GJ@A¬]HAW9←oYK⊃OJAMI←ZAC9r@AG=]iCGPAoSi AiQJAeKC0~∃o←IYHD\∀b@A⊃∃eJA/∃SuK]	CkZ@↓gKK[LAi↑@↓EJAC≥CS]gP@AakIJAgG%K]GJ0@AR]∀\~∃e∃gKCe
PA[←QSmCi∃HAg←1KYrA	rAGkIS←gSQr\@A]JACYM↑AQCYJ~∀~(JdE/%iPAM∃nAKq
KaiS=]fXAQQKeJ↓QCmJ↓EKK\↓]↑@AIKgkYQfXAMI←ZA←YKdAi]K]ir4∃sKCIfA←L↓CeiS→SGSC0@AS]QKYYS≥K]GJ↓eKgK¬eGPX↓iQCh↓QCmJ↓M←k]⊂AiQK%dAoCd~∃S]Q↑@AS9IkgiIr@@A≥K]Ke¬YYr@A←d@↓S]i↑@AiQ∀@AG←5akiKH@@AS9IkgiIr@@A%\~∃a¬eiSGUYCdD∀b\@@@ZAa¬OJ@@Hdr@AQQSf@↓COCS8AgkO≥KgifAiQCP@AS]⊃kgie%CX~∃IKgkYQfACe∀A]KG∃ggCedAi↑AYCYSI¬iJAg
SK]G∀\~∀~(JdE'
SK]G∀Aae←5SgKH↓[C\AA←oKd8@A¬kPACfAM↑A←MQK\AQ¬aaK]LAoQK8AaK←AYJ~∃¬eJAg∃IkGK⊂AErAAe←[SMKfA←_Aa←o∃d@\\8AiQJ↓aeSG∀ACGiUCYYr↓aCSH↓Sf~∃MKemSQkIJA¬]HAS5a←iK9GJDJD\@A)!SfASLAMe←4AiQJ↓E←←V↓UCGW∃h\@AAeKgk5CEYr4∃iQJ↓akEY%gQKd↓eKOCIIfASPACfA∧AO←←⊂Agk[5CerA=LAiQ∀AE←←,OfA[¬S\Aa=S]h\4∀~∀JHE∩Ao%YXXA%\AoQ¬hAM←1Y←of0Aier↓i↑A[¬S]iC%\AiQ∀Aa←g%iS←\↓iQCh↓iQKe∀~∃Sf↓]←iQ%]NAoI←]NA]SiPAYSKoS9NA[C8ACfA¬\AS]→←e[CQS←\AAe←GKMg←d@!←d~∃%]IKK⊂ACfA¬]siQ%]NAK1gJRA9←dAo%iPACQiK[aQS]NAQ↑Ak]⊃Kegi¬]HAQ%ZAMe=Z~∃i!ChAa∃egaK
iSmJ0Aae←YSIS]≤XAQ←]KmKd0AiQCPAoJA9KmKd↓CGhA¬fAiQ=kOP@4∃C]r↓gS]O1JAaKIgaKGQSmJA
C\AG=[aeK!K]HAQQJAo!←YJA5C\\D∀b@ZAACOJ@Dh`\~)/JAG¬\AGKIiCS]1rAYSYJAoSQPAiQ¬hXAEUh~∀~(JdE≥=hA←]1rAQCLA←kd↓k]E←U]IKH↓MKKI%]NA←8@AgG%K]GJ↓GCkg∃HAkf↓i↑AE∃G←[J4∃IKa∃]IK]P@A←\↓ShX@↓EkhX↓Cf@A!CaaK9f@Ao%iPA[¬]r@A=iQKd↓IekOL@AiC-K\AS8~∃S]
eKCg%]NAI=gCOKLXAgG%K]GJ↓QCfA	KK\A≥eCIk¬YYrA
←]mKIiKHA%]i↑@↓BAgY=n~∃C
iS]N↓a←Sg=\D\JD@ZAa¬OJ@bL\@A)!KgJA¬eJAcUCYSM%KHAEd~∀~∀∀dE∩A¬eOkJ↓M←d@↓iQJAICiS←9CXAkMJ@A←_AgGS∃]GJA¬]HAi∃GQ]←1←OrXA]←h↓M←d~)SifA5sgiS→SGCi%←\XA1KhAC1←]JA%ifAC	C]I←9[K]hλJb\@4AaCO∀@djl4∀~∃∪8AeKM∃eK]G∀Ai↑AQQJAaI←a←g¬XAM←HAB@A5←eCi=eSkZ↓←\AG∃eiCS8AKqa∃eS[K9if~∃]SiPAIKG←[	S]C]PA	≥αAEKG¬kgJAQQKrA5SOQh↓EJAI¬]OKe=kfXA]J~∃Q¬mJ@JHE)QK%efASLAGKeQCS]YdABAgQK`AS8AiQJ↓eSOQPAISe∃GiS←8X@AC9HAiQ∃Sd~∃%]SiS¬iSmJ↓SfAi<AEJA¬aaYCUIKH\A'iS1XX@A=]JA[¬rACg,XAoQdAI↑AQQKrA→KKX~)iQKrAQCm∀Ai↑A≥SmJA∧AeKCM←\@A→←dAo!ChAi!KrAe∃G←[[∃]H@A¬hACY0}@A∪LA]←h4∃iQJ↓←mKeISIS]≤A←EY%OCiS=\A←\↓[K\X↓S]GYUIS]N↓[K\A=LAgG%K]GJ0Ai↑A∃qK[aP~∃YS→JASiMKYLA→e←Z@↓iQJA5CI]KMfA←L↓ieKCQS]NA∃mKesQQS]NACfA¬\A←E)KGhX↓B~∃gUMMSG%K]hAIKCg←8XAC]⊂A←]J↓iQCh↓I←Kf↓]←hA∃mK\A!CmJAQ↑AEJ↓ga←W∃\}@A]Qr~∃⊃←KfA%hAQCYJAi↑↓EJAKaaYCS9KH}@↓∪hAo=kYH@↓CaaK¬dAiQ¬hAKm∃\AiQ∀A]←E1Kgh~)CGifA←LAQQJA[=ghAo∃YX[[∃C]S]≤@AaK=aYJA¬eJAa=Sg←]∃H@AEdAiQJ↓G←ee=gSmJ4∃GYS5CiJ@↓←L@AYCYkKL@A←LA←kdAiS[∀\DJbA∪f@↓/KSu∃]ECk4@@AC≥CS]gP@ACY0~∃KqAKeS[∃]iCXAES←1←OrA=d@AKYK\AC1X@AKaaKeS5K]ifAoSi A	≥α|@@A∩Ao←k1H~∃Q∃gSiCQJ@Ai<@AG←9GYkI∀Ag↑@↓Me←ZAiQSLAck←QJv@A!JA[Cd@AgCd@AiQ∀AISe∃Gh~∃=aa←g%iJAg=[KoQ∃eJAK1gJ\~)/KSu∃]ECk4OfAO=CXA←_AOKiQS]NA1S]Kf↓←LAe∃gKCe
PACE¬]I←]∃HAoSQQ←kh↓KmK\4∃QCm%]NAi<AOSm∀ABAe∃Cg←\↓gKK[LAk]Y%WKYr↓i↑AE∀ACGQ%KmKH↓KqGKAhAS\4∃C\A¬i[←gAQKeJ↓iQCh↓G←[E%]KfAAkEYSAQsgQKeSB↓C]HA	keKCUGeCi%FAa←]Kd\~))QSf↓QCfA!CaaK9KHAk9IKdA
←]ISQS←]f↓←LAe∃YSOS=kfAK9iQkg%CgZA¬]HAS8~∃≥CiRA∂KI[C]r0AS\AMiCYS9SghAIkggS∧AC]H↓S\Ai!JAπQ%]BA←_AiQJEπkYQkeCX4∃%Km=YkiS=\D\@↓≠←gh↓YSWK1rASh↓o←\OPAQCaAK\AS8Aβ[KISGB\4∀~∀JHE)Q←MJAoQ<AW]←\AoQ↑↓C]HA]QChAQQKrA¬eJAI<@A]←PA]KK⊂Ai↑A¬gVAo!ChAi!Kr~∃MQ←kY⊂@AI↑8DJb@4AaCO∀@dnf8@@A→∃hA[JACggUeJAi!JAeK¬IKd@↓iQCh↓iQKe∀ASf~)]←iQ%]N@A%\@Ai!J@AE=←V@AQQCh@↓←MMKIf@AC9r@Ao¬r@Ai<@AS]QKeae∃h@Ai!Sf~∃A←[a←MSir\A∩Ai¬WJASPACfA¬]←iQ∃dAaY∃BAi↑↓EJAMIKJA←_AiQJ↓E←]I¬OJ~∃=LAQCYS]NAQ↑AOSYJAeK¬g←]f↓M←dA!SfAI∃]k]G%CiS←9f\~∀4∀@@AQQJA[∃]CGJ↓←L@AMkGPA≥eC]I%Y←ck∃]hAaIKGKaQfASfAiQCPAiQKd~∃eKEkSeJ↓BAae%KgiQ=←HAi<ACaa1rAiQ∃ZAi↑↓aCei%GkYCHAGCg∃fXAC9HAo←UYH[E∀~∃ae%Kgif↓ckSG-YrAGIsgiC1YSuJ↓Ce←k9HAC]dAa←i∃]iSC0AGK]QKdA←_Aa←o∃d\~∃∧AG←e=YYCedA←LAQQSfA%fAiQ¬hAaK=aYJA
C\AE∀ACii¬GWKH↓M←dA]QChAQQKrA¬eJ~∃ICiQKHAiQC8AM←danything specific they have done.  The April 1976
issue of ⊗Ms. has a poignant illustration of this in an article about
"trashing".

%2"An individual is dehumanized whenever he is treated as less than a
whole  person"%1. -  page 266.    This is  also  subject to  priestly
interpretation as in the encounter group movement.

%2"The first kind %1[of computer application]%2 I would call simply
obscene.  These are ones whose very contemplation ought to give rise
to feelings of disgust in every civilized person.  The proposal I
have mentioned, that an animal's visual system and brain be coupled
to computers, is an example.  It represents an attack on life itself.
One must wonder what must have happened to the proposers' perception
of life, hence to their perceptions of themselves as part of the
continuum of life, that they can even think of such a thing, let alone
advocated it"%1.  No argument is offered that might be answered,
and no attempt is made to define criteria of acceptability.  I think
Weizenbaum and the scientists who have praised the book may be
surprised atsome of the repressive uses to which the book will be
put.  However, they will be able to point to passages in the book
with quite contrary sentiments, so the rep@IKggS=\Ao←8OhAE∀AiQK%dAMCUYhL~(_@~∀9π∧A¬U(A⊃I
O&A∧A)%2↓β(A'U≠≠β%%5∪≥∞h~∀]SQK[>`l~∀∪βL@AiQ∃gB@A%]G←]MSgiK9h@Aa¬ggCO∃f@Ag!←nX@↓Sh@A%g\OhAKCgd@Ai↑4∃IKi∃e[S]∀@A/K%uK]E¬kZOf↓a←gSQS←\XAEkh↓iQJA→←YY←]S]N@↓gKKZ↓i↑@A	JAiQ∀~∃E←=VOfA5CS\AA←S]iLt~∀~(]ED@λF\Aπ=[aki∃efAG¬]]←h↓EJA[¬IJAi<@AeK¬g←\AUgKMk1YrAC	←khA!k[C\↓CMMC%ef\D4∃)QSL@ASf↓gkaa=eiKH↓ErAcU←iS]≤@A←m∃e←ai%[Sgi%FAae∃ISGi%←]fA	rAG←5akiKH~∃gG%K]iSMifAC9H@AO%mS]N↓KqC[AYKf@↓←LA]=\[mKIECX@↓Qk[C8@AG←5[k]S
CiS←8\~∃⊃=oKmKHX@A/∃SuK]	CkZA⊃←Kg\≥h@A]¬[JAC9r@AgAKGSM%FAiCMV@Ai!ChAG=[aki∃ef~∃
C]]←P@AGCIerA←UhX@A	KGCkMJ@AQ∀AoSg!Kf@@∀dEi↑↓Cm←S⊂@AiQ∀Ak]]∃GKgg¬erX~)S]iKI[S]C	YJXA¬]HAk1iS[CQKYr@↓giKe%YJAKaKeGSMJA←L↓[CWS9N@AB↓GCiC1←OkJ4∃←LA]QCh@↓G←[aUiKef↓oSYX↓C]HA]SYX@↓]←hA	JACE1JAi↑↓I↑X@↓KSiQ∃dAQKIJAC]⊂~∃]←\A←dA∃mKdD∀b\@A%hASf↓CYg↑↓giCi∃HAiQ¬hAQk5C\AC9HA[C
QS]J↓eKCg=]S]N4∃CeJ↓S]G←5aCeC	YJAC9HAiQ¬hAiQ∀AgK]M←erA∃qaKe%K]GJ↓←LAB↓Qk[C8ASf~)KggK9iSCX↓M←dA!k[C\↓eKCg=]S]N8~∀~∀9ED@D\A)Q∃eJ@A¬eJAi¬gWfAQQCh@↓G←[aUiKef↓gQ←k1HA]←PAEJ@↓ae←OIC[[K⊂Ai↑A⊃↑\D~(~∃'←5JACe∀@AiCMWfA/∃SuK]	CkZ@↓iQS]-fAgQ=kYI\≥hAEJAI←]∀ACh@↓CYX@4~∃aKIQCaf↓M←dAA←YSi%GCXAIKCg←9f\@A=]JA[¬rAck¬eeKX↓oSiP↓QSf@↓a←YSQSGfX↓C]H~)∩AI↑0@AEkPA←Em%←kgYdAG←[AkiKeL@AgQ=kYI\≥hAI↑↓oQCh↓gQ←k1I\OhAEJA⊃←]J\4∃⊃←o∃mKdX↓/KSu∃]ECk4ACYg<A←EU∃GifAQ↑AG←5akiKHAQ←←-kafAQ↑AC]%[CXA	eCS]L~∃C]⊂AG←[AkiKd↓G←]IUGiKH↓agsG!SCie%F@AS9iKem%Kof\AβfAQ↑AiQ∀@AM←I[KdX↓∩~∃G=kYI\≥hAiK1X@Ao!KiQKHAQJA%fAC\↓C]iR5mSmSMKGiS=]Sgh0@AEkPAQJAMKK[f↓i↑~∃!CmJA¬IISi%←]CX↓eKCg=]fAM=dAGC1YS]N↓iQKZE←Eg
K]JD8@A)Q∀A←EU∃GiS←8Ai↑~)G←[aUiKef↓I←S]≤@AageGQSCQeSFA%]iKeYSKof↓CYg↑AQCf↓B@AG=[a←]∃]hAE∃s←]H4∃iQJAG←]YSGiS=\AiQ¬h@Ai!KrAo=kYH@↓]KGKMgCeS1rAI↑↓Sh@A	CIYr8@@A)!kfAQ∀~∃gCefX@JHE/QCPAGC\↓iQJAAgsGQ%CieSMhOfA%[COJ↓←LAQ%fAaCQSK]h↓EJ@A]QK\A!J~∃g∃KfAQ%[gKY_XACf↓BAiQ∃eCaSMhXA]=hACf↓C\AK9OCOK⊂AQk[¬\AEK%]NAC
iS]N↓Cf~∃∧@AQK¬YKdX↓Ekh@↓CfAC8AS]M=e[Ci%←\@AAe←GKMg←dA→←YY←]S]NAIkYKf0AKiF8}DJb4∃)QSL@AgK∃[f@A1SWJ@AiQJAeK]¬SggC9GJ@A∃eB@AIKYSO%←kf@A←EU∃GiS←9f@Ai<~∃ISMgKGi%]NAi!J@AQU[C\A	←IrAQQChA
C[J@↓k`Ao!K\Ag
SK]G∀@AeKYSmKH8@Am∃\~∃i!JA!←AKfAKYK]ik¬YYrA
←]mS9GKHAQQK[g∃YmKf↓iQCh↓eKOCIIS]N↓iQJA	←Ir@↓Cf~∃∧A[CG!S]J@↓M←dAMGSK]QSMSFA←dA5KISG¬X@AaUea←g∃fAoCLAckSQJ@AG=[aCi%EYJ~)oSiPAeKO¬eIS]≤ASh@↓CfAi!JAiK5aYJ@↓←LAi!J@Ag=kX\@↓%KGK9iYr@↓iQKr↓QCmJ4∃iCW∃\AiQ∀AgC[∀AmSK\A←L@↓gikIeS]NA5K]iC0A[KG!C]Sg5fAM←HAgGS∃]iSM%F@A←H~∃ageGQSCQeSFAAkea←MKf\~(~∀]Eλ@DF\↓'GSK9GJ@A!CfAY∃HAaK=aYJAQ↑AB@↓oe←]≤AmSK\A←LAQQJAo=eYH@↓C]HA=LAYS→J\D~(~∃)Q∀@AmS∃nASf↓GQCe¬GiKe%uKHA¬fA[K
QC]SMiSFXAC]H↓iQJA∃qC[a1JA←L4∃GY←
Wo←e,ASfA≥SmK\8@@@Q%hAgK∃[fAgQeC]O∀@AM←HABAG=[aki∃dAgG%K]iSMh@Ai<~∃OSYJAiQ%f@AKaC[aY∀XAEK
CkgJAiQJ↓CImC9GJA←_@AiQ∀AG←[AkiKdA[←I∃XA←m∃d~∃←1IKd@↓[KGQ¬]Sgi%FA[←⊃KYfA%f@Ai!ChAG=[aki∃efAG¬\@AC9HAGY=GWo←IVAGC8Oh~∃5CWJA⊃KGSg%←]f\$Aβaa¬eK]i1rAC]¬YsgSL@A←L↓BAYSYS]NAMsgiK4@ACf↓G←[a=gKH~)←LAS9iKeC
iS]NAaCeQfAeCQQKdAQQC\AQeKCi%]NASP@ACf↓C\Ak9C]CYeuKHA]Q←YJ4∃SfA	CHL~(~∀]Eλ@DF\↓'GSK9GJASLA]←h↓iQJAM←YJA=dAKm∃\A[C%\Ag←UeGJA=LAeK1SCEY∀AOK]∃eCXA-]←oY∃IOJ\λ~∀~∃!←oKm∃dX@A!JAI←∃g\Oh4∃ae←A←gJA¬]r@A=iQKd↓g←ke
KfA←_@AW]=oYKI≥JA←dAgCr↓oQChAiQJ↓YS[SQf@A←_~∃gG%K]iS→SFAW9←oYK⊃OJ@A%fAKq
Kah@↓i↑AG!CeCGQKeSu∀AGKeQCS\@↓iQ←k≥QifA¬f~∀E=EgGK9JD\~(~∀]Eλ@DF\↓πKei¬S\Aa∃←aYJAC]H↓S]gi%ikiS=]fACIJACiQCGWK⊂\D~∀4∃)QKMJ@AS9GYkI∀AiQJ4∃	Ka¬ei[K9h@A←_@E	K→K]gJλ@QgSRX@JI!gsG!←Y←Od@A)←⊃CrJb0AiQJJe≥K\A3←e,~∃)S5KfJb↓	CiB↓¬C]V0@AG←5akYg%mJAG=[aki∃d@AaI←OeC5[Kef0A↔K]9KiP@↓π←YEdX~∃≠¬emS\A≠S]MWrX@↓%←OKH@A'G!C]VXAβYY∃\A≥K]KYXXA⊃Ke	Keh@↓'S[←8X@A∀9.\~∃→←eeKMiKdX↓IoCIHA
e∃IWS\0@A∧]_\A'W%]]Kd0A/CeIK\A≠
πkYY=GP@@!k]iS0AQJ~)oCfA=YHRX↓→CaY¬GJAC9HA→K%E]St8~∀~∀9ED@D\AπKIiCS\↓a←YSQSGCX↓C]HAM←GSC0AmSK]fACe∀AiCW∃\AM←HAOeC9iKH\λ~∀~∀%)QJAYSKnAQQChAT]&\AA←YSGdAS\AYSKi]¬ZAoCL@E[kIIKe←UfDASLAkgK⊂~∃i↑↓gkaa=ehAC8ACii¬GVA←8@EY←≥SGCY%irD@!CfA←Aa←gK⊂Ai↑@	eCiS=]CYSQrDR~)C]HAQQJAm%KnA←_AgGS∃]GJA¬fAB@	gY←n↓CGiS9NAa←%g←\D8@A)Q∀AaQe¬gJ~∀∀dE∪h↓[CrA	JAiQ¬hAiQ∀AaK←AYJOf↓GkYi%mCiK⊂AC]H↓MS]C1YrAC⊃ISGi%mJ~∃!k]OKHAM←d↓aeSm¬iJACUi←[←	SYKf8\\DJD@Q`\L`RA[¬WKfAAgsGQ=Y←OS
CXX~)g←GS=Y←OS
CXXAA←YSi%GCXXAC]H↓iKGQ9←Y←O%GCXAAeKgk5aiS←9fACY0AS\~)←]JAAQeCg∀\@A'%[SYCIYrX@∀dE≠K8AG←k1HAS]MiKCH↓GQ←←MJAi↑↓QCmJ↓iekYd~∃gC→JACkQ←[←E%YKfX↓IKGK9hAiK1KmSg%←\XA⊃KGK]PAQ←kMS]NA→←dAKYKes←9JX~∃=dAG←5M←ei¬EYJX↓gCMJ0AC]H↓oSIK1rAISMieSEUiKHA5CgfAQeC]gA←eiCQS←\\λJb~∃AeKgk5KfAo%IJAC≥eKK[∃]hAC	←khA]QChAQQKgJ↓iQS]≥fACe∀XAoQ¬hASf4∃iKG!]←Y←≥SGCY1rAMK¬gSEY∀XAoQ¬hAiQ∀AKMM∃GifA=LAGQ¬]OKH↓a←YS
SKfA]←kYH4∃EJX↓C]HA]QChA¬GiSm%iSKf↓CS[K⊂AChA
QC]O%]NAa∃←aYJ≥fAiCMiJACIJ~∃a∃e[SgMSEYJ↓M←dA≥←mKe9[K]iL\~∀_~∀]
DA)⊃∀A→∪iαA1¬≠!→
4∀~∀∪AKeQCAfAiQ∀A[←gPAS]i∃eKgi%]NAa¬ehA←_AiQJAE←←,ASfAQQJAC
G←k]P~∃←LAQSfA←o\Aae←≥eCZ@↓→∪5∧@AiQ¬h@Aa¬e←IS∃f@A%=OKeS¬\@A]=\[ISIKGiSYJ~∃aMsGQ←QQKeCArAC]⊂AQSfAC]K
I←iC0ACGG=k]hA=L@AQ=nAg←5JAaK=aYJ@↓CgGe%EJ~∃%]iKY1SOK]
J@AC9HAaKIg←]C1Sir@↓i↑ASP\@@A%\@A[dA←aS9S←\XAShA%f@AcUSiJ~)]CikICX@A→←dAa∃←aYJ↓oQ↑@↓I←\OPAk]I∃egiC9HAiQ∀A]←i%←\@A=LACY≥←eSi!ZAi↑4∃S[C≥S]JAQQCh@↓B@AG=[aki∃dAG←5akiKL@AC]¬Y←O←UgYrAQ↑@Ai!J@Ao¬rAB@↓Qk[C8~∃eK¬g←]f8@@A)!SfAY∃CIfAQ↑@Ai!JASI∃BAiQ¬h@AC
GkeCQJAG←5akiCQS←\A∃]iCS1f~∃G=eeKGPAeKCM←]S] and even to the idea that computer malfunctions are
analogous to human  neuroses and psychoses.  Actually,  programming a
computer  to  draw  interesting  conclusions  from  premises is  very
difficult and only limited success  has been attained.  However,  the
effect  of these  natural  misconceptions  shouldn't be  exaggerated;
people readily  understand the truth when it is explained, especially
when it applies to a matter that concerns them.   In particular, when
an  executive excuses a  mistake by  saying that he  placed excessive
faith in a computer, a certain skepticism is called for.

	Colby's (1973) study  is interesting in this  connection, but
the interpretation below  is mine.  Colby had psychiatrists interview
patients over a teletype line  and also had them interview his  PARRY
program that simulates a paranoid.  Other psychiatrists were asked to
decide  from the transcripts whether the interview  was with a man or
with a program, and they  did no better than chance.   However, since
PARRY is incapable of the simplest causal reasoning, if you ask, "How
do you know the people following you are Mafia" and get a reply  that
they look like Italians, this must be a man not PARRY.  Curiously, it
is  easier  to  imitate (well  enough  to  fool  a psychiatrist)  the
emotional side of  a man than  his intellectual  side.  Probably  the
subjects expected the machine to  have more logical ability, and this
expectation  contributed to  their mistakes.   Alas, random selection
from the directory of the Association for Computing  Machinery did no
better.

	It seems to me that ELIZA and PARRY show only that people,
including psychiatrists, often have to draw conclusions on slight
evidence, and are therefore easily fooled.  If I am right, two
sentences of instruction would allow them to do better.

	In his 1966 paper on ELIZA (cited as 1965),
Weizenbaum writes,

%2"One goal  for  an augmented  ELIZA program  is thus  a system  which
already has access to a store of information about some aspect of the
real world  and which, by  means of  conversational interaction  with
people, can reveal both what it  knows, i.e. behave as an information
retrieval  system,  and where  its  knowledge  ends and  needs  to be
augmented.  Hopefully the augmentation of its knowledge  will also be
a  direct  consequence  of  its  conversational experience.    It  is
precisely the prospect that  such a program  will converse with  many
people and learn something from each of them  which leads to the hope
that  it will  prove an  interesting  and even  useful conversational
partner."%1  Too bad he didn't successfully pursue this goal; no-one
else has.  I think success would have required a better
understanding of formalization than is exhibited in the book.
.item←0;

.CB WHAT DOES HE SAY ABOUT COMPUTERS?

	While  Weizenbaum's  main  conclusions   concern  science  in
general  and are moralistic in  character, some of  his remarks about
computer science and AI are worthy of comment.

	#.  He  concludes  that since  a  computer  cannot  have  the
experience  of a man,  it cannot understand  a man.   There are three
points to  be  made  in reply.    First, humans  share  each  other's
experiences  and those  of  machines  or animals  only  to a  limited
extent.   In  particular, men  and women have  different experiences.
Nevertheless, it  is  common in  literature for  a  good writer  to
show greater  understanding of the experience of  the opposite sex
than a poorer writer of that sex.   Second, the notion of experience  is
poorly understood; if we understood it better,  we could reason about
whether  a machine  could have  a  simulated or  vicarious experience
normally confined to humans.  Third, what we mean by understanding is
poorly  understood, so  we don't  yet know  how to  define whether  a
machine understands something or not.

	#. Like his  predecessor critics of  artificial intelligence,
Taube, Dreyfus and Lighthill,
Weizenbaum is  impatient, implying that if  the problem hasn't been
solved in twenty  years, it is time to give up.   Genetics took about  a
century to go from Mendel to the genetic code for proteins, and still
has  a long way to  go before we will  fully understand the genetics
and evolution of intelligence and behavior.   Artificial intelligence
may be just as difficult.   My current answer to the question of when
machines will  reach  human-level  intelligence  is  that  a  precise
calculation shows that  we are between  1.7 and 3.1 Einsteins  and .3
Manhattan Projects away from the goal.  However, the current research
is producing the information on which the Einstein will  base himself
and is producing useful capabilities all the time.

	#. The book confuses computer simulation of a phenomenon with
its  formalization  in logic.    A  simulation is  only  one  kind of
formalization and not often the most useful - even to a computer.  In
the  first place,  logical  and mathematical  formalizations can  use
partial  information about  a system  insufficient for  a simulation.
Thus the law of conservation  of energy tells us much  about possible
energy conversion  systems before we define  even one of  them.  Even
when a  simulation program  is  available, other  formalizations  are
necessary even to make good use of the simulation.  This review isn't
the  place for  a  full explanation  of the  relations  between these
concepts.

	Like %2Punch%1's  famous curate's  egg, the  book is good  in
parts.  Thus it raises the following interesting issues:

.item←0;
	#. What would it mean for a computer  to hope or be desperate
for  love?   Answers  to  these  questions depend  on  being  able to
formalize (not simulate) the phenomena in question.  My guess is that
adding a  notion of hope to  an axiomatization of belief  and wanting
might not  be difficult.  The study of %2propositional attitudes%1 in
philosophical logic points in that direction.

	#.  Do  differences  in experience  make  human  and  machine
intelligence necessarily  so different that it  is meaningless to ask
whether a machine can be more intelligent than a machine?  My opinion
is that comparison  will turn out to be meaningful.   After all, most
people have  not doubt that humans are more intelligent than turkeys.
Weizenbaum's examples  of  the dependence  of  human intelligence  on
sensory  abilities  seem  even  refutable,  because we  recognize  no
fundamental difference  in  humanness  in  people  who  are  severely
handicapped sensorily, e.g. the deaf, dumb and blind or paraplegics.


α.cb IN DEFENSE OF THE UNJUSTLY ATTACKED - SOME OF WHOM ARE INNOCENT

	Here are  defenses of Weizenbaum's targets.  They are not
guaranteed to entirely suit the defendees.

	Weizenbaum's conjecture thatthe  Defense Department supports
speech recognition research in order to be able to snoop on telephone
conversations is  biased,  baseless, false,  and seems  motivated  by
political malice.    The committee  of scientists  that proposed  the
project  advanced   quite  different  considerations,  and  the  high
officials who made the final  decisions are not ogres.  Anyway  their
other responsibilities leave them no time for complicated and devious
considerations.  I put this one first, because I think the failure of
many scientists to defend the Defense Department against attacks they
know are unjustified, is  unjust in itself, and furthermore has harmed
the country.

	Weizenbaum doubts that computer speech  recognition will have
cost-effective  applications beyond snooping  on phone conversations.
He also says,  %2"There is no question  in my mind  that there is  no
pressing human problem  that will be more easily  solved because such
machines  exist"%1.  I worry  more about whether  the programs can be
made to  work before  the sponsor loses  patience.   Once they  work,
costs will come down.   Winograd pointed out to me that many possible
household applications of computers may not be feasible without  some
computer speech recognition.   One needs  to think %3both%1 about  how to
solve  recognized   problems %3and%1 about  opportunities  to  put  new
technological possibilities  to  good use.    The telephone  was  not
invented by  a committee  considering already identified  problems of
communication.

	Referring  to  %2Psychology Today%1  as  a  cafeteria  simply
excites  the  snobbery of  those  who would  like  to  consider their
psychological knowledge to be above the  popular level.  So far as  I
know, professional and academic psychologists welcome the opportunity
offered  by %2Psychology  Today%1 to  explain their  ideas to  a wide
public.  They might even buy a cut-down version  of Weizenbaum's book
if  he asks  them nicely.    Hmm, they  might even  buy  this review.

	Weizenbaum  has  invented  a %2New  York  Times  Data  Bank%1
different  from  the  one  operated  by  the %2New  York  Times%1 - and
possibly better.  The real one stores abstracts written by humans and
doesn't us@∀AiQJ↓iCaKLAS]i∃]IKH↓M←dAQsaKg∃iiS]≤A[CG!S]Kf8@Aβf↓BAeKMkYh~)iQJ@↓kgKd↓QCfA¬GGKgLA←]YdAi↑A¬Egie¬Gif@↓C]HA
C]]←PAgKCIGPA←8AMKCQkeKf4∃←LAQQJ@AMi←eS∃b@Ai!K[gK1mKfX↓R]J\AQJA%b@ACPAiQJA[Ke
r@A←_AoQCP@AiQ∀~∃CEMieCGQ←efAQQ←kO!hAoCLAS[a=e`∪πw!βπQπ##∃β&K7∃8hP4(&/≠';≥αβ∂?7π+S↔Iα↓βCK};Kπ7~↓βπMαβCOg≡C?S#/∪πC'∨#M1↓αβπM↓∧≠?3Hh+CK␈β?O↔ ¬Bαπ⎇}Vf",Rεn},⊗bα
≤bεOD∧π>␈]LBε∨↑,Rπε]}εf*d∧α¬.lmw↔π]l↔&.O∃@hV=⎇Wπ∂LZ"π≡=_Vv≡T
↔≡r}@λ∞↑λ≥≠d∧~=∧;Yλ
\>8Y$∞~→(∞∞}8z
≤=≤Z.>≤hλ≡Y;InA"Y:.M→<KAQA"B)∀_9|L\(λ∃m≡~λλ	];\zo∀~;@∧|Z=
≤z>Z-lh≥~Tλ≤Y-N8⎇_-ly(≠l@⊂⊂0y≥εA:4→wy4y]9P⊂:≠P⊂22]2v7xλ⊂37i≠pv⊂*~2wy4YyW⊂⊂λ⊂#rw\3rP⊂⊂4y5t≠s3∪yH37y6XvεE:~2wy<H;pyP≤97q0X6<P;\7w3Vλ1:z~2P9t≠zv27	z⊂40]2P12Yw⊂⊂1\4z4aZ⎇2r⊂→7yεE≥9<tw→W⊂⊂*~2P89≠q62vH⊂9rr[yP;2\<P24Y34qz[:⊂:7H6rV⊂_w2⊂⊂∩P40{→P6pr→P77FB9tsw~s4qp[:⊂⊂8≤7sy2\yP⊂4[⊂⊂92\x7w2~w3P⊂≥7P⊂0H⊂1t0[62w3YP⊂39≠vP⊂ \:4:yβE%wr\z62yλ:7P:→v6⊂4≠{P0P_wvx:]2y⊂8≤7sy0[P6tsZ:⊂6pZrP⊂7\⊂2{2[⊂92q[sw4⎇→FE57ZryW⊂λ(2y4_x9P9[vrP9→pr2yλ7s⊂:~4yP9→{4r{H6tst≥⊂40{→P6wy→P9zqXryyWβEεE∧U42y2H⊂4yPλ0P;t≠v2P⊂_t0x:→y⊂⊂0]:0quZw3P⊂λ1wvx≥v9t{→P⊂1w[x:z2\εE89≠sy0v[ry9Qλ7y⊂⊃~0qur\9Q↔⊂λ*44yH6|z4~qpv⊂_2pyzλ64{2\P4w⊂≥42P1[vx:z→yεE6_q7y0]7y<Vλ4yP0[⊂2|8→y:⊂7[⊂0v6λ:42P~w9P0[2⊂7z]9P7sλ⊂:42H:4vrKyt0y~w3FE≤|yz2[V⊂2v_q7y0]2yP:~2P:4[rVyt_y4w3H⊂9|y]2vP;Zz4⊂0\1pw2H32pz≥y2yP≥40zεB42P7→{2y⊂λ27qz[rw:9K⊂0w2λ4yP0[;p|yH1t0w→tw3P≥42P9↑yz2vH12s7\2P42H2{2wβE34|→yP:4→P1:s\P4w⊂≥42P8≤2{4w]yP;2\9tww⊂⊂ v≠⊂:42\rP;4XryP2↑4yz⊗λ1:z⊂∩FE1p[∪z⊂:~4w5P≠s⊂0w≡P4w2~{4r:Xv⊂;t≠P1wvX4w2yH:42vK⊂0w2λ82wx≠2P3r[2y0v≠<FE7]z3y7]P:42[W⊂⊂⊂⊂yP⊂0H⊂60q≠y0z7\<P24\2qz7\⊗⊂⊂$H⊂40{→P:7Pλ897z→qz⊂⊂≥42FE~w:2y→yz9P≠s⊂82[x62P≥t7P8≤7sy0[P7w6≡P80y≥⊂⊂:4[rP0sXtw9zλ:2w2→w1tr\P:7FB7{2yqwvx≠4qpz→P⊂:4→P30qZv4z4YyW⊂⊂λ(2wx≠2P⊂;Z7P⊂9\2w2⊂_v6⊂⊂≥42tyλ:4vrCE897Yy0vvZw3P0[2⊂;t≠P2|1Z0w3rH⊂4w3≠y6pz~ww⊂1≡P;wy→⊂7s⊂≠wzz4λ⊂9wvYz4vr\FE40]2P:7H12P⊂≤92yyYr⊂:7H6purH897x→y⊂⊂;\4z2z\9W⊂⊂∃42P7]42y⊂λ9tr2H7s⊂:~2FE4\yzrPλ4yP:~0z⊂;YP⊂89≠s2yy[y9P7Y⊂1wv\:z2yλ9qtr[1rP⊂≤wvrz~vryP≠7yrP≠zyεE_q4v4]<P:7H;y4z→P⊂0q]:pv⊂_wvx:]2y⊂8≤7sy0[yP⊂:~97zsZ⊂60qZP7s⊂λ890q]4qrFB0w2⊂→w;<Pλ<wzw→ry⊂8→wx62H;t7P_pw⊂⊂≤x2w2λ3:v6λ:4vrH⊂4w⊂≥42P6_q7y0]7y<WβE*42H842w≠vrw7[⊂4yPλ;rv6λ5w7{[⊂4w⊂λ7z42\⊂9qtYw1ryH0w2⊂λ4w⊂7]42y⊂λ4:vp[εE0q]4{4z~ryWεBεE∧kYt⎇2w_0zvP_z:0qZyP:4→P,pv→P⊂1w[x:z2\⊂64w→ztyz⊂)7sYy⊂)qZ0w5VβE0yP→7v67]yP⊗P≥42P4[72y⊂≤zwz2\P0y2H397vH)qt0[5]⊂⊂	Y⊃+t_z⊂4yH1ww:≤4q:z→r⊂⊂;Z2w⊂4]⊂4yFB0yyr\:2r⊂≥40z⊂	z42y→P⊂2|~yz9P_P1ww_rx::Xv⊂10\rP:4_z⊂⊂4\P4w:→y64w→zpv⊗βE7w:≠P;t4Xt⊂⊂6~w3zt\z4qP≤z9:q]:y2yH4w⊂0H3t{2[⊂⊂60[3zpsYP6pxλ2:y4[3P:4→FE:w→2y9z_w24w→P897XryyP_w2⊂⊂≠zz⊂7Y⊂;t4Xt⊂⊂9]qt⊂9]9:qz≥y2yP_y2P⊂_y2pz→rεE2≥y4w3H3rw2\0z4w[⊂-wsλ64w3]tyz4XP:z:→y0w1YynS←Hthing at all.  For
the  term 'conceptual base'  could perfectly well be  replaced by the
word 'something'.    And who  could  argue with  that  so-transformed
statement?"%1  Weizenbaum goes  on to  say that  the  real scientific
problem "remains as  untouched as ever".   On the  next page he  says
that unless the "Schank-like scheme"  understood the sentence %2"Will
you  come to dinner with  me this evening?"%1 to  mean %2"a shy young
man's desperate  longing for  love%1,  then the  sense in  which  the
system "understands"  is "about as weak  as the sense in  which ELIZA
"understood"".  This good example raises interesting issues and seems
to call for  some distinctions.   Full understanding of the  sentence
indeed results in knowing about  the young man's desire for love, but
it would seem that there is a useful lesser level of understanding in
which the machine would know  only that he would like her  to come to
dinner.

	Contrast  Weizenbaum's demanding,
more-human-than-thou attitude to  Schank and Winograd
with his respectful and even obsequious attitude to Chomsky.  We have
%2"The linguist's first task is therefore to write grammars, that is,
sets  of   rules,  of  particular  languages,   grammars  capable  of
characterizing all and only the grammatically admissible sentences of
those languages, and then to postulate principles  from which crucial
features of all such grammars can be deduced.  That set of principles
would then constitute a universal grammar.  Chomsky's hypothesis  is,
to put  it another way,  that the rules  of such a  universal grammar
would  constitute  a  kind  of  projective  description of  important
aspects of the human mind."%1  There is nothing here demanding
that the universal  grammar take into account the  young man's desire
for love.  As far as I can see, Chomsky is just as much a rationalist
as we artificial intelligentsia.

	Chomsky's goal of a universal grammar and  Schank's goal of a
conceptual base  are similar, except that  Schank's ideas are further
developed, and  the  performance of  his  students' programs  can  be
compared with  reality.  I  think they wilL require  drastic revision
and  may not be on the  right track at all, bu@P@AiQ∃\A∩A¬ZAakIgkS]≤AB~∃ICiQKHAISM→KeK]P@AYS9JA←LAeKgα+πK∂Bβ∂?;≡+K;'v9β#?:↓βS=π∪↔CK/≠↔;QαβS#∀hSπON→β≠π∨#@~πM↔"ε≥dεNwL]FfN|]g"α,VNvt
W/∨D
6v␈t⊗⊗␈↑Dπ&FT∞v␈⊗LEbα∧←⊃PVNL\∩εO4∧π&z∧∞7&∂.@λ∧\[{$∧→<∩.>→;;mMy}(∧∞X=~↑Hλ≥
;Hλn[{(∧
_;Yn\9y+↓Q\Y9l≡Y~;Lt≥~→-≡H≠~-l⎇:<nM8h≤L↑≤Y<l]]_=
≥{H_.4≤y8m⎇Y_<O∃HλU

<h_.∞≤[x,=β"Z≡h≤∀M}Y9λ∧~9YM≤⎇;≥¬D~_<d=≥≤L≤⎇→9∧Y=h∧∞≤X8nM=~;ml<\k∧;Yλ
<h≠\λ≥≠aQYY=d{{<∞↑→<H∞∞[y|L≥<kλ.=λ∩$∞⎇~;
D≥~~-mh~=∧}h≤Z,⎇≥C!!"B5l]>Y;L,=;(≡≤≤[nl<h≠ld≥~→$λz≠{.=}(λ∞<z≠{mD|h~≡9z≥∂∀_=≥
≡≥9→!Q]≠⎇l≡Y≤h
<z_;M5λ∃z-my|X,D_;Y∧
⎇~→.$⊂2(,<y9∧
_;Yn\9y(∞,<y8.,z→<N5Hλ∪ma"\_,|(&εEλ~→$∧≤⎇_.L<kλ∧VH[8-o(≠~-l⎇:<nNkλλm|H→/;<≠Uλ∪[l≥(λ⊂m
{<zo∃β"XL]~9=LT≥~_.Dλ→;M}9zλ∞M~;Zm≥Yhλ≤[⎇=∧
_;Yn\9y(∞,;8:-nhλ≥
t_Y(∧≠{Y$∞≠c"M|x⎇<∂∀λ≥~](≥<l\];≠∂∀→[|D∂9=λ∀≠~=∞M→(λ∞⎇~;→%D_;Y∧∞~_=∧;↑(\Y[|ND≥≠c!,{{]L↑]λλ∞M→:<D∧≤≤Y.<;]λ∧∞~→;n-9<h∧
;]≠d∧_{{.∞=→<D∧≠;y]≤hλ∞⎇⎇;→¬Dλ~9AQX=≥]<≥→,D_↑(∞M→(≤]|≠→$Y<⎇∧∧≤=8-M9Z9,Eλ_Y$(→~.l<\z-⎇H→\M⎇(≥~T≠8:-a"]_.=kHλ∧λ;Yλ∧∞~→>$∞Z9z∞M≡(λ∞<9(λ
mh≤≠m≥]λλ∞Mhλ≤n;Y~-lh_;O∀λ≠yD∧≥~→-≡C"Y-l<Yz,↑h≤⎇∞\≡:;Lt≥~→$∞{|Zd
yH≥
(~_,=y<\edI,#!!"B5

<h_N-;Y|d∞~→(=_<≥↑H≠{D∧λX{m↑≥;≤m≡Y(_m⎇<≥=↑H≤≤M||X;-\<\hAQX;~,≡hλλM8zy..hHλ
≥]≠h∧(λ≤m<\→.$λ→[l><kH∧∧λ⊂z
⎇<z}$}hλ≠≡→<⎇∧∧_[{m1"I,J,9[→,>~;{N4λ≠{D	_;Yn\9y)&∀λ≠8-<<hλ
mhλ≤L\Y<Y-ly(λ∞Mhλ≥
(λ≥m}Zhλ
|C"Um≥[y|L≤λ∀l=_;ZeDλ⊂z≡[Z8-5λ∃z-M|kλλ-x\[ntλ≠|D
z;≠
≤;(∃m⎇y≤h∧∞≠h≠L≥9#"M⎇[≡(∧(→Y.t≠yH∞M≠|y$∧≥z≠d
_=Y$→=Y-M|→9∧∧≠_<L|(_{m↑≥=→.$≤}<nL;<h∞M_=β!.{|Zd∞z=~∧
X=≥.,;λ≠≥Y⎇8,|(_;LDλ≥z
t≥|Z.L(≤_.<\h
⎇H≥~Tλ≤y-\;]~,>h≠yAQ[X=∞↑X;λ∧
_;Yn\9y+D∧∃~→$∧_8⎇∞\;λ≡-};Yh∧{{<∞↑→<H∞∞[y|L≥;9<N4λ≥z
t_x;
A"]~]<y;∞l<h~≤zy<N4λ_;LDλ≥z
tλ_{m\(_{
}y<⎇∧∧≥≠h∧
99=
≥Yhλ
|:>Y-lX=;$}c"Y↑x|Z.∞~;{D≠{InDλ≥|M≡→(≤≡→<\d
{Hλ
l=≥<L≥λ≠_-l⎇89lUHλλ
=h~=∧∞y9;.1"]~≡λ≥~T~_8m<<\h∞⎇≠|y$∞{|Zd
Y99∧
[⎇λ,(≤⎇∞\~99∧<Y(
⎇;[yn,9λ
<z_;M5β"Y.EHλ_-EHλλ∞⎇≠h_.,(λ≤∞-yY<n=|\h∧;Yλ∞<;Z;n$λ≤xm≤;]~.>≤kH∧∧∃~→$λz≠{.=}#"N<z≠{mD≠8>$∧_Y(∧;8X.,<|y,D_↑(∧∞~→(l8⎇λ∧∞~_=∧∧~=λ
<hλ
⎇[≡(∧∞Y8y-n≠≡#!,<\Z.l9λ_.D≥~→$∧_{{L=≥<z-⎇H≥~≡λ≥~T≤y;,≥]~8n4≠yH∧
X=≥.,;λ≠≥Y⎇8,|(~<aQ[;|LTλ→]-l_;9-n_;λ∞M_;H∧
=≤h∞?;]_/¬λλ≥m
;→(λ→(_X.<9λλ∞,<y8.,z→<N4~_=LQ"XY,]H≤≥..⎇:;Lt≥~~.4≠~;LT→[|DZ9]\;H≡,\<\kAQC"B*M→(≠n↑≤z9T≠x\l↑]Y<D∞z≠⎇-Lλ_Y$=x<LT≥~_.D≥≠h∞={9(←≥→;ND≥~~.1"Z<d∧_(≤
≥≠≠⎇dZ9z∞Dλ≥z.M~;H	UR+U¬dλλ⊂m
{<zo∀_;Y∧∧∩_;
L(_<LT≠[⎇∧∧≥≠h,#"Y
≡{≠y|9λ→N-{(λ	UR+U¬dλ_;LD≠Y:.M→<H∧
<hλ	];\zo∀(≥m
|y(∧∞⎇≥9]]≤h∧
_=Y!Q\~;ml9<Y,Dλ≥~T⊂2(∧<≤≤M|8zλ∞Mhλ≠L≡≥<X-Dλ≠_-l⎇89lUHλλ
<z_;M4~<h∧∞=:=Q"\y,><Y(≡λ⊗8-L+Hλ
|:>Y-lX=;$;≤{d
_<h∞L;]<LUHλ∩
}y=Y.%λ≤{m\(_<n=<⎇_-nβ"\∞-yY<n=|\z
≡≤h~-d≠~;L}:<⎇
≤|h≠,∨(_Y$=λ≤nL:y+∧<|→,=8;≠∂∀_=λ	UR+U¬a"C"A_;≠→-dλ∪Y.|;≠λ≥Yλλ	<XY..λλ∀m≥;{H∧<Y(>Z=~,=>Y9∧∧→[|D∧_Y:-lc"[nl<[|∞M;:<nM8h_-lλ_<LT_{{N=9→<L\λ≠;n,;≠≡$→9Y,>~=Y$[|H≡≥→;.∞~;Yd∞≠c"LL<x|M≤Y(~∞]8;\d<h→
≤YY<L]Xy+.,9≥8m≥Yhλ
\8z~-l<kH∧
z;;md|h≥M≤=hλ∞M_=β!.~→(
∞;8;D
<h_$∞z;<
L(≤}.>→;(∧
;H_${{<
L>λ→-nZ<[mm9;]∧
<h≤m≥Y{→,D≠⎇=↓QY[|D∧_=≥≤zkH∧	;H≠/∀≠|~-m;{K∧∧≥~→/∀≥y<LT≠⎇Y.-|≥~-]<⎇~,5λ_Y,<=<y$∞~→:.!"Qt
4≠;y]λ≠{D∧≥z~,=λ≥~←(≤≥.Dλ≥~]<H_L↑≤h≥l≡{I⎇∧∧→{{lD→;[n\zH∧∧∪8>,,#"SL↑y;≠∧}h_⎇..Y;]∧∧,\≤M|≥8⎇
≥{Hλ∞?<⎇→-T≠;y]≤i,$∞z;≠∧∞{|Zd∧≠⎇=∧Y=≥↑KC"H≡h≥≠d∧≥z→.M→<H
∞;8;D
9;]≥λ≤⎇∞.8⎇≥.,(≥z-Mλλ→.l;]≥,≥≠≡(∞N<[H
}=λ≥
t_Y#!.z;<
L+λ∩$∞X8z-M_=→$]=⊂~w1v4[2P:7H:42P≥4r{P≥40z it will turn out to
be One of the mostcomplex biological phenomena.

	I  regard Forrester's  models  as  incapabhe of  taking  into
acCount qualitative changes,  and the world models they have built as
defective even  In their  own terhfXAEKG¬kgJ@↓iQKr↓YKCm∀A←kh4∃gCiUeCiS=\[←L5IK@7∞s⊃β↔4∧f.∨N4π&F≡@λ<9[[nD_Y(M<x{nl<Y9∧↑(_n↑]Y+,m=≥~-lc"X.4≠≠{Lt_<h∀λ≤}.L;(~.∀≤X=U;yK,←≤_;N=;{H
M;:=\Hλ∧	;|Y-}Y<C∧	(→≠md⎇β"L≤xy<∞D~~<d∧_{_-≥(≥~≡λ~~.4≠;y]≤h_.,(λ_L↑≥→<D∞⎇:=\λ≥~≥H≥~T≥;X-≤→9β!-:;Y∧
;HλM≥]→<N∞Y=~-lhλ~
}h≤{l=8;λ∧∞}<⎇]<h_L]_=Y$%λ_].Dλ∃y-∨Y;XL≡;)|aQ\x<L<<{(∧
{Hλ∞9y(∧∧M
D∧~<h∧∞;X{mnZ;Xm≥YkH∧∧λλ∩Tλ≤=-}→<h∧λ[|\L↑⎇→<EA"HVlL<z<L≤[→(∧
;y→.4≠yH∧Y:_.m;|H
|Hλ≥
(≤{l=8;λ∧∞}<⎇]7(	&.y9;$∧≥≠h,#"\
}|z8ML(≠{MO(~9D∞y(~≡Y(_${{y∧∞;Y→..⎇_;LM;Yh
|Hλ≥
(≤}.>→;(O;X;-≤|c"L≥Yλ_.,(≥z-M~;Yd∞≠h→-l≥<Y$∞~→(∞<;→K,M<xz.
~;Y$;Yλ∞∞Y<|n↑Y<h∞M_=
↑<⎇β!,8x{m↑_;↑$∞~→(L<z<L≤[→(∧
;y→$$,+H∧
y:>L]XX=-Tλ_{m]9;]∞5λ	,D*~→<LTλ~<aQ];Y
}8]→,M≡(≤m⎇9(~-n→<\∞,=_=
≥{H≠ld≥~→$∧≥{|LNh	|o≡⎇→;$t_;Y∧∧y≡;L≥:8|dq"]z
≤zλ≥m};→λ
L;Yλ∀_Y;M≤{H≠,\;Z;Lt≥≠h∞Mvation"%1.  Sorry, but
it looks ok to  me provided one  is suitably critical of  Forrester's
proposed social  goals and  the possibility  of making  the necessary
assumptions and putting them into his models.

	Skinner's behaviorism that refuses to assign reality to
people's internal state seems wrong to me, but we can't call him
immoral for trying to convince us of what he thinks is true.

	Weizenbaum quotes Edward Fredkin, former  director of Project
MAC,  and the late  Warren McCulloch  of M.I.T. without  giving their
names. pp. 241 and  240.  Perhaps he thinks  a few puzzles will  make
the  book more  interesting,  and this  is so.    Fredkin's plea  for
research in automatic programming seems to overestimate the extent to
which our society  currently relies on  computers for decisions.   It
also  overestimates  the  ability  of  the faculty  of  a  particular
university to control the uses to  which technology will be put,  and
it underestimates the difficulty of making knowledge based systems of
practical  use.  Weizenbaum is  correct in pointing  out that Fredkin
doesn't mention the  existence of genuine  conflicts in society,  but
only the new left sloganeering elsewhere  in the book gives a hint as
to what he thinks they are and how he proposes to resolve them.

	As  for the quotation from (McCulloch  1956), Minsky tells me¬
"this is a brave attempt to find a dignified  sense of freedom within
the  psychological determinism morass".   Probably  this can  be done
better now,  but Weizenbaum  wrongly  implies that  McCulloch's  1956
effort is to his moral discredit.

	Finally, Weizenbaum  attributes to me  two statements  - both
from  oral presentations  - which I  cannot verify.   One of  them is
%2"The only  reason we  have not  yet succeeded  in simulating  every
aspect of the real world is  that we have been lacking a sufficiently
powerful  logical calculus.   I am  working on  that problem"%1.  This
statement doesn't express  my present opinion  or my opinion in  1973
when I am alleged to have expressed it in a debate, and no-one has
been able to find it in the video-tape of the debate.

	We can't simulate  "every aspect of the real  world", because
the initial state  information is never available, the laws of motion
are imperfectly known, and the calculations for a simulation  are too
extensive.   Moreover,  simulation  wouldn't  necessarily answer  our
questions.   Instead, we must find out how to represent in the memory
of a computer the information  about the real world that  is actually
available to a machine or organism with given sensory capability, and
also how to  represent a  means of drawing  those useful  conclusions
about the effects of courses of action that can be correctly inferred
from  the attainable information.   Having  a %2sufficiently powerful
logical calculus%1 is an important part of this problem - but  one of
the easier parts.

[%3Note added September 1976%1 - This statement has
been quoted in a large fraction of the reviews of Weizenbaum's book
(e.g. in %2Datamation%1 and %2Nature%1) as an example of the arrogance
of the "artificial intelligentsia".  Weizenbaum firmly insisted that
he heard it in the Lighthill debate and cited his notes as corroboration,
but later admitted (in %2Datamation%1) after reviewing the tape that he
didn't, but claimed I must have said it in some other debate.  I am
confident I didn't say it, because it contradicts views I have held
and repeatedly stated since 1959.  My present conjecture is that
Weizenbaum heard me say something on the importance of formalization,
couldn't quite remember what, and quoted "what McCarthy must have said"
based on his own misunderstanding of the relation between computer
modeling and formalization.  (His two chapters on computers show no
awareness of the difference between declarative and procedural
knowledge or of the discussions in the AI literature of their
respective roles).  Needless to say, the repeated citation by reviewers
of a pompous statement that I never made and which is in opposition to
the view that I think represents my major contribution to AI -
is very offensive].

	The second quotation from me is the rhetorical question, %2"What
do judges know that we cannot tell a computer"%1.  I'll stand on that
if we make it "eventually tell" and especially if we require that it
be something that one human can reliably teach another.

α.cb A SUMMARY OF POLEMICAL SINC

	The speculative sections of the book contain numerous dubious
little  theories, such as this one about the dehumanizing effect of
of the invention of the clock:  %2"The clock  had created literallq  a new
reality; and thatis what I meant when I said earlier that  the trick
man turned that prepared the scene for the rise of modern science was
nothing less  than the transformation of nature and of his perception
of reality.   It  is important  to  realize that  this newly  created
reality was and remains an impoverished version of the older one, for
it rests on a rejection of  those direct experiences that formed  the
basis for, and  indeed constituted the  old reality.  The  feeling of
hunger was rejected as a stimulus for eating; instead one ate when an
abstract model had achieved a certain state, i.e. when the hand  of a
clock   pointed  to   certain  marks   on  the   clock's  face   (the
anthropomorphism  here is highly significant  too), and similarly for
signals for sleep and rising, and so on."%1

	This idealization  of primitive  life is simply  thoughtless.
Like  modern man,  primitive man  ate  when the  food was  ready, and
primitive man  probably had  to start  preparing it  even further  in
advance.   Like  modern man,  primitive man  lived in  families whose
members are  no more likely to become hungry all at once than are the
members of a present family.

	I get the feeling that in toppling  this microtheory I am not
playing  the  game;  the  theory  is  intended  only  to  provide  an
atmosphere, and like the reader of a novel, I am supposed  to suspend
disbelief.   But the  contention that  science has  driven us  from a
psychological Garden of Eden depends heavily on such word pictures.

	By the way, I  recall from my last sabbatical  at M.I.T. that
the %2feeling of  hunger%1 is more often the %2direct social stimulus
for eating%1 for the  "hackers" deplored in  Chapter 4 than it  could
have  been for  primitive man.   Often on a  crisp New  England
night, even  as the clock strikes three, I hear them call to one
angther,  messages  flash  on  the  screens,  a  flock  of  hackers
magicallq  gathers,  and   the  whole  p@%Gike∃gckJACgg∃[EYrAekg!Kf~∃
QCii∃eS]N↓←MLAQ↑AπQ%]Ci←]\\~∀4∀]Si∃[>`v4∀~∀∪$AMS]⊂AiQJ↓E←←VAgkEMiC]I¬eHACLABAa%KGJA=L@Aa=YK[S
CXAoISiS]≤~∃S\↓iQJA→←YY←]S]NAIKgaK
ift~(~∀∩F8A)QJACki!←dAQ¬fAMC%YKH@↓i↑Ao=eV@A=khAQ%fA←o8~∃a←MSiS←9fA←\↓iQJA%ggkKLAQJA⊃SgGkMgKf\A≠CW%]NAC8AKqiIK[JAMiCiK5K]hA%\~∃←9JAaY¬GJAC9HABA
←]ie¬ISGi=er@AMiCiK5K]hA%\AC]=iQKd↓SfA]<@Agk	giSiUiJ~∃→←d@AQesS]≤@Ai↑AiCW∀@ACY0@AiQ∀AMCGQ←ef@↓S]i↑ACGG=k]h@↓C]H@↓eKCG @AB~)G←]g%IKeK⊂Aa←g%iS←\8@A+]MkgaS
S←kf↓eKCI∃efAG¬\AG←5JACo¬rAoSQPABA≥eKCh4∃mCe%KirA=LAmS∃ofXA¬]HAi!JAE←=VAGC8AEJAUgKHAQ↑AgkAa←eh↓G←]iICISGQ←er~)a←gSQS←]f8~∀~∀$F\A)!JAG←5akiKHAYS]≥kSgiL@@ZA]S]←OICHXAMGQC],XAKh8ACX\@ZACIJ~∃I∃]SOe¬iKH@ACf@↓QCGW∃ef@A¬]H@A
←[ak1gSmJ@AG←5akiKH@Aae=OeC[5Kef@↓Er~∃%]]kK9I↑\~(~∀∩F8A∨]J↓o←kY⊂@AYS-JAi↑AW]←\A[←e∀@Aae∃GSgK1rAoQ¬hAES=Y←OS
CX@A¬]H~∃AgsGQ=Y←OS
CX@@↓KqaKIS[K]Qf@AC9H@@A
←[akQKd@A¬aaYS
CiS←9f@@A!J@AM%]If~)CGGKAiCEY∀\@A%∃mSKo∃efAQ¬mJAC1eKCIdAIeC]\ABAYCeSKQrA←L↓G←]G1kgS←9fA←\4∃iQSLAa←S9h\~∀4∀∩F\↓)QJAQKe[fECki!K]iSDX@E=EgGK9JDX@↓C]H@	IKQk5C]Su¬iS←\↓CeJ~)kgKHACf@↓GYkEL\@@AQQSfA%f@Ao!Ch@A5CiQK5CiSG%C]f@↓GCYX@Eae=←LAEd~∃S]QS[SI¬iS←\λ\~∀~(∩F\AQQJAE=←VAK9G←ke¬OKf@↓BAg]=EEKedAiQCPAQCf↓]↑@A9KKHAQ↑ACe≥kJ~∃→←dASQfAa←%]h@A=LAmS∃nAEkPA[Ke∃YrAkQiKef↓G←IJ↓o←eILXA←\↓QKCe%]NAo!SGP~)iQJA¬kISK9GJASL@AgkAa←gK⊂ACaa1CkHA=dAQSMf@ACLAiQJ↓GCgJA[Cr↓EJ\@A)QJ4∀Je≥∃n@A'
SK]i%ghJbAeKm%KoKdAGKeQCS]Yd@AgC1SmCi∃f@AS8@A[←Mh@A←_@AiQ∀~∃S]QK]IK⊂AaYC
Kf\~(~∀∩F8A
S]¬YYrXAoQK8A[←e¬YSuS9NASfAE←i AmKQ∃[K]h↓C]H@↓mCOk∀XASh4∃S]m%iKf@↓CkiQ=eSiCISC\@↓CEkg∀@AKSQQKd@↓ErAKaSgiS9N@ACUiQ←e%ir@A=dAEr↓]Kn~)a←YSQSGCX↓[←mK5K]if8@A∪[¬OS]J0@ASL↓s←jA
C\X@↓iQCh↓iQSf↓E←←V↓oKeJAiQJ4∃ESE1JA←L↓g←[J↓EkeK¬kGeC
rXAJ9N\@A¬\A∨M→SGJA=LA)K
Q]←Y=OrAβMgKgg5K]hX4∃iQCPACGcUSeKHAa←o∃dA←m∃dAiQ∀AG←[AkiS]≤A←dAMGSK]QSMSF↓CGiSYSiSKLA←LA∧~∃k]%mKeg%irXAMiCiJ0@A←d↓G←k]Qer\@A'kaA←gJ@↓/KSu∃]ECk4OfAg1←GC]L@AoKIJ~∃G=[ES]∃HAoSQP@JeQQJAEUeKCk
eCiS@AKi!SFJb↓iQChαβ#?3'→βS#∂!βπ;JβCK?⊗c↔44V≠π9β⊗)βO?g3↔⊃β↔I↓β¬εcπ]β6{K'&#';≥π≠?7↔&C';≥αβπ;⊃ε	βW⊗+πW∂⊗∂e↓ε{_4+.∨↔Iαβg?Wv9β3π?K↔KMαβS=↓ε+;≠?⊗≠∃↓βO!9↓↓¬β?OS.cπS∃αβ≠GK&C↔I↓ε	↓β[∞;W∀4R)J#Wn;∃↓¬∪↔O↔∂∪∂!α∞≠Q∃Eαβπ;⊃ε	↓↓π+3'~β';S/∪↔OQ∩↓β?K>;'k∂#'?9π;'S hS7?K*β↔π∨/⊃↓βg␈+;≥↓εcπ←g/∪M↓β∨+';≥αβS=β>+Q↓βW+∪∨↔~↓βS=αβ3↔∨O≠3πS*↓β;↔8h+';&+KCK/#πS'}sMβ?2↓βS#*απ∂Qr↓α?;*↓β∂πrβO↔∃ε	β3π⊗{KπS␈∪e↓βv+↔∪'v9β7?⊗(4+3∂;g↔K~βS#πrβO∂'.sS'O'→↓βπv!β¬αG+7π;*αK↔O.K∂!ααπ∪7Ns'OS⊗S?Iε≠πCπ⊗c∀4+}1β≠?⊗∪'∪∪Ns≥β?∩βK↔G.KK';:βπ37␈≠QβπwKS#'v984(hP&%β≡+∃β;zβ↔['&+;∂∃π##πQ¬;↔'k.sπWjβ≠?K≡+↔MβFKMβ←␈∪-β.K;≥β/≠↔⊂4VK9βSFKM↓β>emβF)β∪?/≠9∨Qπ+O∃β&C∃↓βεCKπO*↓∃K3∞KOO↔Rβ';;␈3↔I∃
β←#'≡Aβ'LhSS#∃αβ←?Wf!7∃αβO∂'.s∂∃↓ε∪WK↔∂+∂Kπ";M↓β∞sπ3??+∃↓β}1↓βSF)↓↓β.≠?;?nKOQ∨_h)∃Kf'OO/Qβ≠πO∪∃∃Ebβπ;⊃εC∃β;/3↔Iβ/≠↔Mβ&C∃β'v#↔≠'vKS∃βεCKπO*↓'Qπ≠#?Wf 4+*↓β∪↔≡K∪↔⊃∩β←#'≡Aβ'Mε	β∂?nk?9↓ε+cCK/≠O'?rβ?→β&C∃β/∪↔πW∨∪πS'~β↔S#N→84*F{←↔[/⊃1β#*↓β#π~β∂↔K&';3J↓β∨'6+9β#O→β≠↔fc?]↓ε≠?7C/#↔Iβ≤≠'↔;&KOSMαβπP4Vc↔πO"βO?7*βK↔π≡{9βSzβ←?K↔Iβπ␈+QβC␈#↔;SN1βSO∪π;;Jp4(4Ph*3↔"β7∃β≡{;∂3.#∃βSFKMβO.≠S'?rβ←'SBβ¬βG.{SπSN{9β≠⊗{5απv#K↔]∧!9α←FKS∃0hSS#∃ε3'KO βCK↔≤¬⊗&.nDε}2λ=w⊗v]MB¬.m≡f/↔=≡GJb∞Mε∂"∞<V.o4↔πεM≤6∞⊗LTπ&xQ.FF*∞∞&/≡]nBπ≡≡NV∂&≥⎇bαj
mw"ε⎇mGJε≥dε≡}↑∞W&/$∞6≡N]l6*b.W"ε≥N6xh-≥bε⊗≥⎇F}?∃dαjα$V$Nr≥Fbε]|F/⊗d
εO∨M}'Jb
≥g&/,lW⊗.l<Rπ>≡Mαπ≡=≤Vv≡T
⊗ph.Mε*π>↑πε␈<\BεNnLW⊗/>Dε}2∞,VfN⎇≥vrb
mrεn≡NF/∩

w:ε=⎇g≡≡≤]g&N}↑2π∨\=hV≥nF/⊗l↑&.v<Tεn∂∀
ε∂6T&..eDεF∂4∞&/∨]NF."
≥bπ&Tε&O,↑7"ε↑m⊗g~-w&B∞MphW,]FN>≥⎇bε∞lDπ&z∞<6N.l<Rbε≥lBεNnl↔⊗N≤-GKZ≥f"b
⎇bπ&Tε␈&↑"εF≥lB`h,≥Fbπ]nG⊗∞]\Vff\Dπ≡≡≤]g&Nm≤2εNnlW∨&≤|↔&N⎇eBεvt
V∂'L↑"εF}tε&∞l|W⊗␈↑1PW&t∞&.f≤⎇⊗}r∞=vn*
|bεON4π∨&≤|W~ε←∀εF∂lTπ≡.]\V"εm}"π&Tπ&N\Tπ&z,R`h-↔~ε≥nf∂⊗≤≤&gJ∞,W∨.NLV"ε≥dπ&FT
εN>↑7"ε⎇⎇v"ε-}FBε|dπ⊗.M≤vN}d⊗v Q-v2π<=⊗.v<T"+
d∧¬∨..>FO'↑LR↓6]}&∞f≡O∩ε6}$↓7⊗]M⊗>N⎇dε∞vD∞FF*∞↔⊗∞MLV`h-≡2ε≡L\↔∩r∧λg⊗∞m=GJb∞Mε*εl\V⊗f]lW∨~
|bπ&Tπ⊗.≤>FN}d∞Fzε≡NF∞≡>4ε}pQ.6≡N]nFN6≤4ε7⊗\\F}j∞⎇w↔⊗≤↑2εnT
V␈⊗T∞FF∞d∞FF*∞>G⊗.l}FBε|dπ&FT↔'&≤=7~pQ `h%h4∩¬yλ∃"¬yz%∀LZ4α∧)zU"∧9yU¬-HZ%~∧~(R¬<~*$uHXCxh!⊃PPL}.Vn⊗M≥f:ε≤-w/"
|VOV]l&∂.T}2εn≡>F∞↑↑4ε∞vD
V␈⊗≥M↔VNlqPVO4∧εv␈D∧ε.v}\vBr∧∧α∧>]nVNvT∞v␈↔-≤W~α∞∞&}o∞LV"α∞Mε*α-v}ZD∧ε∞vD
V∞w⊃Q'ε.}
F*π=↔⊗*∞Mε.jd∧∧F/,Tε∂⊗T∞FF*|Vw.≥lRε≡⎇l6/⊗n4π&F≡Dα∧J<⊗ph-≤F.wM≤gJα≥f"πMRαε}
⊗vN⎇n2αε|dε}vT∧ε≡}↑∞W&/$∧π≡≡≤]g&O>Dε∞⊗}↑BαπMVO⊂Q.&/≡⎇NW&N⎇g"¬>≡BεO4∞FF*L⊗v>↑$π&F≡Dπ&FT6}o∞↑F/∩∞⎇⊗fb
LV∞"∞Mrε
l⊗g≡QQ&n}L]Bε}d
V∞st∧α¬>≡BεO4∧π&FTF∞v|↑"π&≡Bαε=⎇Wπ/L↑'~π⎇≥Fbε,Tαεn≡>W≡.GqPT≡≥dαεG]\⊗rnL↑f.b≡'&Nm≤6N∞D
⊗w&]MFN>]l6*α,Rε∞=
⊗/6\Grαα
⎇ε∂"D
⊗2ε≥o∩`h-]w&Ol≡FN}l≥Bε≡≡&∞∨L↑&O∨M≤7~π⎇≥Fbε≡DεF∂lWrα¬⎇}Vf"∞Mε*ε≤=εN/l]V.wD∧ε}0Q,↔↔&≤m⊗≡N≥DεNwL]FfN|]f≡*,Rε>⎇|Bε␈$&∞"mw∩ε∞]V∞v≡O∪xh!⊃PRv≡LVm{π1PRv,$α∩~dλF}∂4∞FF*=voπ↑LW∩ε]|F.b
LV∞"∞Mrε
l⊗g≡T
V}&]Dε}2
\⊗rr!Q hP→
↔∨&}-⊗≡∞MO∩bπMRεn\=ε∞v≡:FN~
]v&.D
v2πMRεf≤lRε∞lDπ&FT
v␈⊗LAPV6⎇IF␈>\@αε∞m≥VO∨M_2αε]|F.g4∧εNr≤6≡␈,L⊗v≡T∧π>OM∧απ>
≤6Bb∧∞π⊗N↑>G~ε≥l@hV\\FN≡≥lRεn]dπ'⊗≤\Bπ&t6␈↔,\7"ε\≥F7.l>FN}n4ε}∩∞Mε*ε]nfO⊗⎇mV.wD⊗v"
\⊗ph,/∩εNlNV≡Nltπ∨ε≡-↔'~∞Mrε⊗]↔6*∧&/'L↑"bα
,Wεf≤9⊗v:∞Mε.j/∩εn\=ε∞v≡>FN_Q-V}&]N2π⊗↑	F∞≡\Dαπ≡≥V∞v≡=Rε↔∀
V.&≤=⊗v*d∧¬⊗␈?,⊗Zε←∞εfN=≡FgJ∞⎇w.fD
FN↑QQ'&z.&Nvt∞FF/<Tεn}L]G~ε,≤6Zb∧&.≡≡XlT~→(m;Y≤d∞~→;$
;|Y$∧λZ≥-\;HK∧]=β!-→(~,⎇[|Y.4≥~→$∞x9λl8⎇∞M_=∞M→>(M{I⎇∧∞{|ZeD_Y8l≡<y(∞M→(≥m}[→λ
≡{I⎇↓QX{{N>≤]8nL9λ≥
=λ≥l∨+Hλ∧
~→(∧∞≤Y+,={<≥.L<H∪,\z_;M≡⎇~8d∧≠;y]≤h≠lDλ≥~Q"[:-lλ≥y.,+λ~-d≠>(
}~;Z-⎇Kλ≥-n⎇8xl↑|y]-E_]5∧∧∩(⊂~~4w5@≥42P8≤|qt7[7sty]9FE8≥y9z`)ng  computational  models of  mental  pRocesses  may eventually
develop a really beneficial psychiatry.

	Philosophical and moral thinking hasn't yet found a model
of man that relates human beliefs and purposes to the physical
world in a plausible way.  Some od the unsuccessful attempts have
been more mechanistic than others.  Both mechanistic and non-mechanistic
models have led tat harm when made the basis of political
ideology, because they have allowed tortuous reasoning to justify
actions that simple human intuition regards as immoral.  In my
opinion, the relation between beliefs, purposes and wants to the
physical world is a complicated but ultimately solvable problem.
Computer models can help solve it, and can provide criteria
that will enable us to reject false solutions.  The latter is
more important for now, and
computer models are already hastening the decay of dialectical
materialism in the Soviet Union.

.bb "#. What is the danger thatcomputers will be misused?"

Up to now, computers have been  just another labor-saving technology.
I  don't agree  with Weizenbaum's  acceptance of  the claim  that our
society would have  been inundated by  paper work without  computers.
Without computers, people would work a little harder and get a little
less for  their work.  However, when home terminals become available,
social changes of  the magnitude of  those produced by the  telephone
and automobile  will occur.  I  have discussed them  elsewhere, and I
think they  will  be good  -  as were  the  changes produced  by  the
automobile and  the telephone.   TyRanny  comes from  control of  the
police coupled with a tyranniCal ideology; data banks will be a minor
convenience.  No dictatorship yet has been overthrown for lack of  a
data bank.

	One's estimate  of whether technology  will work out  well in
the future is correlated  with one's view of how it worked out in the
past.  I think it has worked out well - e.g. cars were not  a mistake
-  and am  optimistic about  the future.   I  feel that  much current
ideology    is   a   combination   of   older   anti-scientific   and
anti-technological  views with  new  developments  in  the  political
technology of instigating and manipulating fears and guilt feelings.

.bb "#. What motivations will artificial intelligence havE?"

	It will have  what motivations we  choose to give it.   Those
who  finally create it should  start by motivating it  only to answer
questions and should have the sense  to ask for full pictures of  the
consequences of alternate actions rather than simply how to achieve a
fixed goal, ignoring possible side-effects.
Giving it human motivational structure with its
shifting goals sensitive to physical state would require a deliberate
effort beyond that required to make it behave intelligently.

.bb "#. Will artificial intelligence be good or bad?"

Here  we  are  talking   about  machines  with  the  same   range  of
intellectual  abilities  as are  posessed  by humans.    However, the
science fictiOn vision of robots with almost precisely the ability of
a human is  quite unlikely, because the next  generation of computers
or even hooking computers together would produce an intelligence that
might be qualitatively like that  of a human, but thousands  of times
faster.   What would  it be like  to be able  to put a  hundred years
thought into every decision?  I think it is impossible to say whether
qualitatively better answers would  be obtained; we will have  to try
it and see.

	The achievement of above-human-level  artificial intelligence
will  open to humanity an  incredible variety of options.   We cannot
now fully envisage what these options will be, but it  seems apparent
that one of the first uses of high-level artificial intelligence will
be to  determine the consequences of alternate policies governing its
use.  I think the most likely variant is that man will use artificial
intelligence to  transform himself, but  once its  properties and
the conequences of its use  are known, we may  decide not to use  it.
Science would then be a sport like  mountain climbing; the point would
be to discover  the facts about the world using some stylized limited
means.   I wouldn't  like that,  butonce  man is  confronted by  the
actuality of  full AI, they may find our  opinion as relevant to them
as we  would  find  the  opinion of  ⊗Pithecanthropus  about  whether
subsequent evolution tooi the right course.

.bb "#. What shouldn't computers be programmed to do."

	Obviously one shouldn't program computers to do things that
shouldn't be done.  Moreover, we shouldn't use programs to mislead
ourselves or otherpeopLe.
Apart from that0A∩AM%]HA]=]JA←_A/KSiK]ECUZOfA∃qC[a1KfAG=]mS]
S]N\4∃⊃←o∃mKdX↓∩AI←UEhAi!JACIYSgCE%YSir↓←LA[¬WS]N↓eWE←QbAoSQPAQk5C\[Y%WJ~∃5←iSm¬iS←]¬XAC]⊂AK[←QS←]C0AgieUGike∃fAiQ¬hA[S≥QhAQ¬mJAe%OQif↓C]H~)IkiS∃bAS]⊃KaK]⊃K]iYdA←LA!k[C]L\@A≠=eK←m∃dXA∩↓iQS],AShA5SOQh↓EJ~∃⊃C]OKI←kfAQ↑A[C-JABA5CGQS9JAiQ¬hAKm=YmKH↓S]iK1YSOK9GJAEdAeKgA←]IS9N~∃i<ABAaI←OeC4AWLAIKoCe⊃fAC]⊂Aak]%gQ[K9ifAk9YKgf↓SifAQeCS]∃ef~∃U]IKeMiC]H↓iQJA%]iKY1KGik¬XAC]⊂A[←i%mCiS=]CXAMiekGQkeJA	KS]N4∃Km←1mKH\4∀~∀∪¬YX@AQQKgJ↓ckKgQS←]fA[Ke%hAC]⊂@AQCYJAeK
KSmK⊂A[←e∀@AKqQK]gSYJ~∃I%gGkgMS←\X↓EkhA$AiQS9RAiQ∀A←]YdAeCi%←]CX↓a←YS
rA]←\ASfAQ↑AKqAKGhAQQJ~∃AK←aY∀AG←]→e←]i∃HAEr↓iQJ@↓ae←E1KZAi<Ak]I∃egiC9HAiQ∃SdAE∃gh@A%]iKe∃gif~)EKii∃dAiQ¬\AoJA]←n↓GC\\AmK8@ASL↓MkYX↓β∩Ao∃eJAi<@ACeISmJA9KqhAeKCdX4∃iQSL@Ao←UYH@A	JAeS≥Qh\@Aπ←eIKGh@↓IKGSMS←]fAoSY0AeKcUSeJ@↓C\AS9iK]g∀~∃KM→←ehAQQChA
C]]←P@AEJ↓[←ES1SuKH↓i↑@A
←]gS⊃KdAC8AKmK9ikCY%irAi!Ch@A%f~∃gQSYXAIK[←i∀\@@A%[COS9JACg-S]NAQQJAaIKgSI∃]iSC0AGC]⊃SICi∃f@Ai<AIKE¬iJ~∃=\A),↓oQCh↓KCGP↓←LAi!KZAo=kYHA⊃↑ACE=khAK¬GPA←_AiQJ↓M←e[LAiQCPAMkY0Aβ∩~)[SOQPAiCW∀\~∀~(]EDAIKMKe∃]GKfh~∀~∃5GπkY1←GPY\]&\PDrjlR↓)←oCIHAg←5JAGSIGkSiIrA←L↓KiQS
CXAe=E←if↓←dAC8@~∃←	gKem¬iS←]¬XAgG%K]GJ↓←LAi!JAOK9KgSf↓←LAg=GSCX↓KmCYUCiS←8AS\AQQJ~∃5S]H[1SWJA	KQCm%←dA←_ACei%MCGiL\@Je¬GiBA	S←iQ∃←eKi%GBJb0Jg1∩∀dYaCIif@f<hX~∀DhnZbTl~∀~(Jo)Q%fAeKYSKnA%fAMS1KHACLA/∪i≤]%∃-7!+λY∃≠πtAChAM*[β∩↓←\Ai!JAβ%AαA]KP\~∃β9rAG←5[K]iLAgK]PAi↑A)≠π↓'T[β∩A]SYXA	JAgi=eKHA%\AiQ∀AISe∃Gi←edA!+∧1∃≠ε~)CYg↑↓W]←o8ACf@∀e≠Gπ¬eiQr≥fAY∃GieSA≠CO¬uS]J∀n\@AQQJAG=[[K]P~∃MS1KfAo%YXAE∀AIKg%O]Ci∃HA/%5≤\DXA/%5≤\HXAKi\Jb~(~∀]E∃OS\AYKeECQSZ~∀4∃∃←Q8A≠Gπ¬eiQr4∃βei%MSGS¬XA∪]QKYYS≥K]GJ↓→CE←ICi←ed~∃'i¬]M←e⊂XAπC1SM←e9SB@rPf`j~(]K]H4∀]←]
JAS]⊃K]h@@v~∃w⊃CiK|4∀